Gradient Flow of the Stochastic Relaxation on a Generic Exponential Family
نویسندگان
چکیده
We study the natural gradient flow of the expected value Ep [ f ] of an objective function f for p in an exponential family. We parameterize the exponential family with the expectation parameters and we show that the dynamical system associated to the natural gradient flow can be extended outside the marginal polytope.
منابع مشابه
Statistical model of daily flow in arid and semi arid regions
Abstract Stochastic model for synthetic data generation is not available for daily flows of intermittent streams. Such a model is required in the planning and operation of structures on an intermittent stream for purposes where short time flow fluctuations are important. In this study a model is developed for such a case. The model consists of four steps: determination of the days on which fl...
متن کاملElectro-magneto-hydrodynamics Flows of Burgers' Fluids in Cylindrical Domains with Time Exponential Memory
This paper investigates the axial unsteady flow of a generalized Burgers’ fluid with fractional constitutive equation in a circular micro-tube, in presence of a time-dependent pressure gradient and an electric field parallel to flow direction and a magnetic field perpendicular on the flow direction. The mathematical model used in this work is based on a time-nonlocal constitutive equation for s...
متن کاملStretched-exponential behavior and random walks on diluted hypercubic lattices.
Diffusion on a diluted hypercube has been proposed as a model for glassy relaxation and is an example of the more general class of stochastic processes on graphs. In this article we determine numerically through large-scale simulations the eigenvalue spectra for this stochastic process and calculate explicitly the time evolution for the autocorrelation function and for the return probability, a...
متن کاملVariational Inference on Deep Exponential Family by using Variational Inferences on Conjugate Models
In this paper, we propose a new variational inference method for deep exponentialfamily (DEF) models. Our method converts non-conjugate factors in a DEF model to easy-to-compute conjugate exponential-family messages. This enables local and modular updates similar to variational message passing, as well as stochastic natural-gradient updates similar to stochastic variational inference. Such upda...
متن کاملAnalytical Analysis of The Dual-phase-lag Heat Transfer Equation in a Finite Slab with Periodic Surface Heat Flux (RESEARCH NOTE)
This work uses the dual-phase-lag (DPL) model of heat conduction to demonstrate the effect of temperature gradient relaxation time on the result of non-Fourier hyperbolic conduction in a finite slab subjected to a periodic thermal disturbance. DPL model combines the wave features of hyperbolic conduction with a diffusion-like feature of the evidence not captured by the hyperbolic case. For the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2014